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What is claimed is: 



^ ^ 1 . \ A hyperlinked broadcast system comprising: 



r 

2 \ a video source; 

3 \a video encoder in communication with said video source, said video 

4 encoder producmg a transport stream; 

5 anVnnotation source; 

6 a dam packet stream generator in communication with said annotation 

7 source and said video\ncoder, said data packet stream generator producing encoded data 

8 packets; and \ 

9 a multiplexer system in communication with said video encoder and said 

10 data packet stream generate^ said multiplexer generating a digital broadcast signal 

1 1 comprising an augmented transport stream from said transport stream and said encoded 

12 data packets, \ 

13 wherein said video encoder provides timing information to said data packet 

14 stream generator and said data packfet stream generator synchronizes annotation data 

15 from said aimotation source with a video signal from said video source in response to 

16 said timing information. \ 

1 2. The system of claim 1 wherem said timing information comprises one of 

2 timestamp information, timecode information, numbering information and global 

3 time of day. 

1 3. The system of claim 1 wherein said annotation data comprises mask data 

2 and at least one of textual data and graphics data. 



1 4. The system of claim 3 wherein said mask dkta includes location 

2 information of an object in an annotated video frame. \ 
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1 ^ \ system of claim 4 wherein said location information includes a 

2 graphics location reference that represents a fixed relation to a set of pixels associated 

3 with said object. 



1 6. The sVstem of claim 5 wherein said graphics location reference includes 

2 an upper left most pixe;! in said associated pixel set. 

1 .7. The systerrrof claim 5 wherein said graphics location reference includes a 

2 centroid pixel of said associated pixel set. 



Q 
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Q 
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1 8, The system of claim 3 wherein said mask data comprises location and 

2 shape information of an object in a vkleo fame to be annotated. 

1 9. The system of claim 8 whb^ein said shape information is represented by a 

2 graphical overlay of said object. 

1 10. The system of claim 8 wherein sai^ 

2 outline of said object. 



shape information is represented by an 



1 11, The system of claim 8 wherein said shapeunformation is represented by a 

2 mathematical representation of a set of pixels associated v^h said object. 



12. A hyperlinked broadcast and reception system c€pprising: 
a video source; 

a video encoder in communication v^th said video s\urce, said video 



4 encoder producing a transport stream; 

5 an aimotation source; 

6 a data packet stream generator in communication with said^armotation 

7 source and said video encoder, said data packet stream generator producing\^encoded data 

8 packets; 
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W • 

9 amultiplexer system in communication with said video encoder and said 

10 data packet streankgenerator, said multiplexer generating a digital broadcast signal 

1 1 comprising an augmented transport stream from said transport stream and said encoded 

12 data packets; \ 

13 a broadcast channel in communication with said multiplexer system; 

14 a receivervin communication with said broadcast channel; and 

1 5 a display device in communication with said receiver, 

1 6 wherein said video\ncoder provides timing information to said data packet 

17 stream generator and said data packet stream generator synchronizes annotation data 

18 from said annotation source with a video signal from said video source in response to 

19 said timing information, and \^ 

20 wherein said display device displays said annotation data associated with said 

21 video signal in response to a viewerrcquest on a frame by frame basis. 

1 13. The system of claim 1 2 wherein said timing information comprises one of 

2 timestamp information, timecode infomiation, frame numbering information and global 



3 time of day. 



^ 



1 14. The system of claim 12, wherem said annotation data comprises mask data 

2 and at least one of textual data and graphics data. 



1 15. The system of claim 14, wherein said mask data and said at least one of 

2 textual data and graphics data are transmitted over separate streams in said broadcast 

3 channel. 

1 16. The system of claim 14 wherein said masl^ data comprises location 

2 information of an object in an aimotated video frame. 

1 17. The system of claim 1 6 wherein said mask data further comprises shape 

2 information of an object in an aimotated video frame. 
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1%, The system of claim 12 wherein said timing information is employed to 
synchronize the display of annotation data from said annotation source with said video 
signal from said video source. 



19. The system of claim 18 wherein said timing information comprises one of 
timestamp information, timecode information, frame numbering information and global 
time of day. 



20. The system of claim 12 wherein said system transmits information related 
to said viewer request to ar\emote location over a backchannel conmiunications channel. 



21 , The system of claim 20 wherein said backchannel communications 
channel is a store-and-forward channel. 



22. The system of claim 12, wherein said annotation data comprises 
information regarding goods and services for sale. 



23. The system of claim 12, wherem said annotation data comprises non- 
commercial information. 



24. A hyperlinked reception systemVomprising: 

a receiver in communication v^tma broadcast channel; and 
a display device in communication with said receiver, 
wherein said receiver decodes a digital broadcast signal to recover a video signal and 
annotation data; and \^ 

wherein, in response to a viewer request, said display device displays said 
annotation data associated with said video signal on a frame by frame basis. 



25. The system of claim 24 wherein timing information is employed to 
synchronize a display of said annotation data with said video si^al. 
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1 26. The system of claim 25 wherein said timing information comprises one of 

\ 

2 timestamp information, timecode information, frame numbering information and global 

3 time of day. 

1 27. The system of claim 25 wherein said receiver synchronizes said annotation 

2 data with said video signal in response to said timing information. 

\ 

1 .28. The system of claim 24 wherein said annotation data comprises a plurality 

2 of annotations having equal timing information, and said viewer request comprises an 

3 indication as to which annotation of said plurality of annotations is to be displayed. 

1 29. A hyperlinked reception system comprising: 

2 a receiver in communication with a broadcast channel; and 

3 a display device in comrnunication with said receiver, 

4 wherein said display device displays annotation data associated with a video 

5 signal, in response to a viewer request, on a'frame by frame basis, said annotation data 

6 being associated with said video signal in response to Aiming information. 

L, 1 30. The system of claim 29 wherein said'timing information composes one of 

fU 2 timestamp information, timecode information, frame numbering information and global 

□ 3 time of day. \ 



1 SLA method of generating a hyperlinked video signal, comprising: 

2 providing a source video; 

3 encoding said source video with a video encoder to produce a transport 

4 stream and timing information; 

5 providing a source of annotation data; 

6 communicating said transport stream and timing information^from said 

7 video encoder and said annotation data from said source of annotation data to a data 

8 packet stream generator, said data packet stream generator synchronizing said^annotation 
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9 data with a video signal from said video source in response to said timing information 

10 and producing encoded data packets. 

1 32. \ The method of claim 31 wherein said timing information comprises one of 

2 timestamp information, timecode information, frame numbering information and global 

3 time of day. 



1 .33. The me^od of claim 3 1 , wherein said annotation data comprises 

2 information regarding goods and services for sale. 



1 34. The method of claim 3 1 , wherein said annotation data comprises non- 

2 commercial information. 



1 35. The method of claim 3 1 wherein said annotation data comprises mask data 

2 and at least one of textual data and graphics data. 



1 36. The method of claim 35 wherein said mask data includes location 

\ 

2 information of an object in an armotated video frame. 



1 37. The method of claim 36 wherein said location information includes a 

2 graphics location reference that represents a fixed relation to a set of pixels associated 
O 3 with said object. 



1 38. The method of claim 37 wherein said\graphics location reference includes 

2 an upper left most pixel in said associated pixel set. 

1 39. The method of claim 38 wherein said graphics location reference includes 

2 a centroid pixel of said associated pixel set. 

1 40. The method of claim 35 wherein said mask data comprises location and 

2 shape information of an object in an annotated video frame. 
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1 4l\^ The method of claim 40 wherein said shape information is represented by 

2 a graphical (^verlay of said object. 

1 42. The method of claim 40 wherein said shape information is represented by 

2 an outline of saidVbject. 

\ 

1 43. The method of claim 40 wherein said shape information is represented by 

1 44. The method ofvdaim 3 1 , further comprising: 

2 communicating said transport stream and said encoded data packets to a 

3 multiplexer system, said multiplexer system generating a hyperlinked digital broadcast 
D 4 signal comprising an augmented transport stream from said transport stream and said 
ji 5 encoded data packets. \ f\ 

0 \ 

C \ 45. The method of claim 44 wherein said annotation data comprises mask data 

B \ 

7i 2 and at least one of textual data and graphics data and wherein said mask data and said at 

3 least one of textual data and graphics data represent separate streams contained in said 

□ 4 hyperlinked digital broadcast signal. \^ 

□ 1 46. The method of claim 44, further comprising: 

2 broadcasting said hyperlinked digital broadcast sig^d^ 

1 47. A method of viewing a hyperlinked video signal^comprising: 

2 receiving a hyperlinked video signal comprising an augmented transport stream; 

3 demultiplexing said augmented transport stream to recovera transport stream and 

4 encoded data packets; \ 

5 displaying said transport stream framewise as a video on a displ^; 

6 decoding said data packets to recover annotation data and timing information; 

7 synchronizing said armotation data with said video using said timinganformation; 

8 and \ 
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9 ih response to a viewer request, displaying said annotation data on said display on 

10 a frame by^frame basis. 



1 48. bhe method of claim 47 wherein said timing information comprises one of 

2 timestamp information, timecode information, frame numbering information and global 

3 time of day. 



1 49. The method of claim 47, further comprising 

2 transmitting information related to said viewer request to a remote location over a 

3 backchaimel communicationSvChannel. 



1 50. The method of claim 47, further comprising: 

2 in response to a viewer prompt, accepting from a viewer information regarding a 

3 commercial transaction, and completing said transaction. 



1 51. The method of claim 50, wherein the information regarding a commercial 

2 transaction accepted from a viewer comprises at least one of a viewer's identifier, a 

3 viewer's address, an identifier of a viewer' s^^nancial account, a viewer's password, a 

4 viewer's personal identification number, a quantity, a model, a size, a color, a descriptor 

5 of a good or service to be vended, and a price. ^ 
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